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ABSTRACT 


The  detection  of  stochastic  processes  in  noise  is  considered, 
under  the  assumption  that  neither  the  signal  nor  the  noise  need  be 
Gaussian.  The  detector  structure  is  found  in  terms  of  the  semi¬ 
invariants  of  the  signal  and  noise  processes.  The  general  detector 
structure  is  extremely  complicated,  but  a  threshold  form  may  be 
obtained.  For  symmetric  processes  with  zero  mean  and  independent 
sampling,  the  energy  detector  is  obtained.  Error  probabilities  are 
computed  for  the  energy  detector  with  non-Gaussian  signal  process 
and/or  non-Gaussian  noise.  It  is  shown  that  large  degradations  in 
sensitivity  occur  if  the  noise  is  highly  impulsive  in  character,  but  the 
non-Gaussian  character  of  the  signal  process  is  found  to  have  very 
little  effect  on  the  detector  sensitivity. 
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I.  INTRODUCTION 


The  purpose  of  this  study  is  to  examine  the  detection  problem 

for  stochastic  waveforms  in  noise,  under  the  assumption  that 

neither  the  waveform  nor  the  noise  need  be  Gaussian. 

The  detection  of  signals  having  some  randomized  parameters 

is  well  known,  and  the  detection  of  Gaussian  processes  has  been 
1  2 

studied  extensively  *  .  The  background  noise  is  almost  always 

assumed  to  be  Gaussian,  although  a  small  amount  of  work  has 

3  4 

been  done  on  detection  in  other  types  of  noise  9  ,  The  detection 

of  signals  which  consist  of  known  waveforms  with  some  random 
parameters  (for  example,  random  amplitude  or  phase)  is  important 
in  radar  and  in  some  types  of  communication  systems  which  use  a 
small  number  of  fixed  waveforms  to  transmit  digital  data.  The 
detection  of  Gaussian  processes  is  important  in  radio  astronomy 
and  in  radiometry. 

The  transmitted  signals  used  in  most  communication  systems  do 
not  fit  into  either  model.  A  communication  signal  usually  has  an 
extremely  complex  statistical  structure,  and  in  many  cases  of 
practical  importance  the  statistical  structure  is  unknown  and  cannot 
be  represented  by  a  convenient  mathematical  model.  Speech  is  a 
case  in  point. 

The  assumption  of  Gaussian  background  noise  is  valid  in  most 
applications,  since  the  noise  is  usually  dominated  by  receiver  noise. 

In  some  situations  of  practical  interest,  this  is  not  the  case.  Non- 
Gaussian  background  noise  is  found  in  underwater  sound  propagation, 
in  VLF  reception,  and  in  reception  in  the  presence  of  countermeasures 
or  other  man-made  interference. 

Under  these  circumstances  it  is  natural  to  inquire  whether  a 
more  complete  statistical  description  of  the  signal  and  noise  might 
be  of  value.  We  shall  assume  only  that  the  signal  and  noise  are 
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additive  and  independent  of  each  other,  and  that  certain  statistical 
quantities  (moments  or  semi-invariants)  exist.  Due  to  well  known 
analytical  difficulties,  we  shall  not  usually  be  able  to  obtain  closed- 
form  solutions.  Threshold  detectors  and  series  expansions  are, 
however,  possible  and  indicate  the  general  nature  of  the  optimum 
detectors. 
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II.  STATISTICAL  PRELIMINARIES 

An  arbitrary  random  process  y(t)  may  be  described  at  a 
single  time  t  =  t^  by  its  ensemble  statistics  of  the  first  order. 

The  first  order  distribution  is 

wi(yi*  4i> =  Prob  [y  s  vt  at  t  =  *4]  »  (i) 

which  gives  the  distribution  of  values  of  y(t)  at  time  t  =  t^,  when  a 
large  ensemble  of  similar  processes  are  measured  simultaneously. 

If  y(t)  is  measured  at  two  times  t  =  t^  and  t  =  t^,  the  two  first- 
order  distributions  are  not  usually  independent  if  t^  -  t^  is 
sufficiently  small.  The  second-order  distribution  is  their  joint 
distribution 

W2^yl’  tl  :y2’  *2^  =  Prob  [y  5  yd  at  t  =  and  y  s  Yz  at  t  =  t2J. 

(2) 

The  second-order  distribution  is  related  to  the  first-order 
distribution  by 

W2(yl*tl:y2t2)  =  Wl(yl'tl)  '  W2(y2*t2lyl’tl)  ’  (3) 

where  the  conditional  distribution  is 

W2^y2*  tZ^Yl9  tl^  =  Prob  [y  *  yz  at  t  =  t^  given  y  ^  att=  t . 

(4) 

Similarly,  the  n-th  order  distribution  Wn(y^f  12**  *  *  *  yn’ ^n^ 

describes  the  ensemble  statistics  of  measurements  taken  at  n 
times:  t^,  t^»  ...»  t^.  Conditional  distributions  are  defined  by 
obvious  generalizations  of  (4). 

The  n-th  order  distribution  is  a  distribution  in  n  random 
variables  and  has  the  usual  statistical  properties  of  an  n-variable 
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distribution.  The  expected  value  of  any  function  G(y^f  y^,  .  •  . ,  y  ) 
of  the  variables  is 

E(G)  =  J.-.J  G(Yl . yn)  dWn(yi,ti:...:yn,tn)  .  (5) 

The  characteristic  function  is 

4>  (u1»  U 2 . un)  =  E  £exp(iu^y^  +  iu2y2  +  .  .  .  +  iunYn)]  •  (6) 

and  the  moments  and  semi-invariants  may  be  defined  in  the  usual 
way  as  the  coefficients  of  the  expansions  of  ^  and  log  ^  into  power 
series . 

The  distribution  may  be  discrete,  continuous,  or  of  mixed 

type.  It  is  continuous  if  the  distribution  function  W  is  continuous 
7  r  n 

and  if  the  density  function 

0nW 

Wn(yl,tl:'  -  '  :yn*  ‘n*  =  8  5  7775  (7) 

yl  y2  yn 

exists  and  is  continuous  everywhere  except  possibly  on  a  set  of 
probability  zero. 

The  random  process  defined  by  this  ensemble  of  random 

waveforms  y(t)  is  stationary  (in  the  strict  sense)  if  the  hierarchy  of 

distributions  is  independent  of  the  time  of  measurement.  The 

first-order  distribution  is  entirely  independent  of  the  time  of 

measurement,  and  the  higher -order  distributions  depend  only  on 

the  time  differences  t,  -  tJt  t-  -  tJ(  t  -  t . . 

c  13  1  n  1 

In  practice,  measurements  of  statistical  quantities  cannot  be 
made  on  an  ensemble  of  random  waveforms  because  only  a  single 
source  of  the  random  process  in  question  is  available.  We  must 
then  measure  the  time  statistics,  that  is,  the  statistics  of  a  single 
member  y(t)  of  the  ensemble.  Let  t  =  t  be  an  epoch,  and 
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consider  measurements  made  at  times  t  =  t  t  ,  .  ,  t  Let 

12  n 

Yk  =  y(t  +  tj^)  and  let  G(y^,  .  •  . ,  y^)  be  an  arbitrary  function  of  the 
measured  quantities.  Then  the  time  average  of  G  is 


<G(yry2 . yn)):;lim  tJ 

1  "►  00 


T/2 


-T/2 


G(y 


1* 


i  y  )  dt 
7n  o 


(8) 


This  average  exists  if  G  is  a  bounded  function.  It  can  easily  be 

shown  that  the  time  average  is  independent  of  the  epoch  t  and 

depends  only  on  the  time  differences  t^  -  t^,  t^  -  t^,  .  •  ,  ,  tn  -  t^. 

This  average  can  therefore  be  expected  to  be  equal  to  the  ensemble 

average  E(G)  defined  by  (5)  only  for  stationary  processes.  It  is 

not  sufficient  for  the  process  to  be  stationary,  since,  if  it  consists 

of  two  subprocesses  with  different  statistics,  the  time  average  (8) 

will  depend  on  which  subprocess  the  waveform  y(t)  belongs  to. 

If,  however,  the  process  is  stationary  and  has  no  stationary 

subprocess  whose  probability  is  different  from  one  or  zero,  then 

the  process  is  ergodic  and  the  time  average  (8)  is  equal  with 

probability  one  to  the  ensemble  average  (5). 

In  this  case,  we  may  determine  the  statistical  properties  of 

the  n-th  order  distribution  W  (y. ,  t. .  ;y  ,  t  )  by  measurement  of 

n  71  1  7n  n  1 

the  corresponding  time  averages  of  the  single  random  waveform 
y(t)  which  is  at  our  disposal.  The  average  value  of  y(t)  is 


(  y  ^ 


lim  7f 

T  -  oo 


y(t  +  t)  dt 
o  '  o 


(9) 


and  its  mean-square  intensity  or  average  power  is 

T/2  2 

<  y2>  =  lim  i  J  [y(to  +  t)]  dto  .  (10) 

T  00  -T/2 

Similarly,  moments  of  all  orders  are  defined  by 
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yz 


lim  » 
T  -oo  1 


T/2 

/lA[»“0  +  ‘i»] 


(11) 


These  time  averages  are  equal  with  probability  one  to^he 

corresponding  moments  E(y),  E(y2),  E(y^  *y^  2.  .  . yn  n)  of  the 

distribution  W  . 

n 

The  average  (y^y^)  *8  autocorrelation  function  of  y(t). 

The  various  higher -order  moments  are  similarly  equal  to  higher  - 
order  correlation  functions  of  y(t).  Knowledge  of  these  higher  order 
correlation  functions  is  equivalent  to  knowledge  of  some  of  the 
higher -order  moments  of  the  ensemble  distributions. 

We  need  not  assume  in  the  following  that  the  processes 
considered  are  ergodic  or  even  stationary,  since  we  shall  usually 
assume  that  we  know  the  n-th  order  ensemble  distribution.  Our 
results  will  be  obtained  in  terms  of  the  moments  of  the  ensemble 
distribution,  and  these  moments  are  equal  to  the  corresponding 
higher -order  correlation  functions  when  the  process  is  ergodic. 
Higher -order  moments  and  higher -order  correlation  functions  are 
merely  different  descriptions  of  the  same  statistical  quantities. 
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III.  THE  STATIONARY  POISSON  PROCESS 

A  very  general  class  of  random  processes  can  be  constructed 
from  sums  of  the  form 
oo 

y(t)  =  T.  am  u(t-tm)  •  U2) 

m=o 


where  u(t)  is  a  known  waveform,  and  a  and  t  are  randomly 

mm 

distributed  amplitudes  and  epochs.  If  we  assume  that  the  epochs 
tm  are  uniformly  and  independently  distributed  in  time,  then  the 
probability  that  exactly  N  impulses  u(t)  will  appear  in  an  observation 
interval  f tQ,  tQ  +  t"|  is  given  by  the  Poisson  distribution 


PX(N)  = 


(13) 


where  n  is  the  average  number  of  impulses  per  unit  time. 
The  n-th  order  distribution  of  y(t)  is 


Wn(yl,tl;* *  ‘  :yr 


tn)=  T  Px(N)Wn(y1,t1;...;yn,tn|N),  (14) 
N=  o 


where  Wn(y^,t^;...  ;yn»tn|N)  is  the  n-th  order  distribution  assuming 
that  exactly  N  impulses  are  present.  The  characteristic  function 
of  this  conditional  distribution  is 


^(ulf  .  .  . ,  un|N)  =  E  £exp  (  l  iuiyN(tl))]  *  (15) 


where  y^(t)  is  a  waveform  of  the  form  (12)  with  exactly  N  impulses 

with  the  observation  interval.  If  the  amplitudes  a  have  the 

m 

distribution  w(a),  then 


s  pi*’  ®  ^  o  r  n  — 

^(u4,  . .  . ,  un|N)=  ^  J  daw(a)*  ij,  j  expj^ia  £  UjU(t^ -t)dtj 


(16) 
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Then  the  n-th  order  distribution  (14)  has  the  characteristic  function 


•Mu*. 

...,un)  = 

+  00 

[  T  J 

w(a) 

-  00 

r  -  r  +  00 

=  exp 

M 

-  00 

®  (nT)N 


N=o 

t  +T 
„  o 


"NT 


exp 


M 


,N 


(17) 


r  *  +  oo  .  t  +T  n 

exp  [  n  J  w(a)  j  °  {exp  (ia  £  u^u(t^ -t))-l}dtj 


As  T  -►  oo,  the  limits  of  integration  become  (-co,  +  oo). 

The  8 emi- invariants  of  this  process  are  the  most  convenient 

means  of  description.  Expanding  log  ^  (u^,  .  • . ,  un)  in  a  power 

series,  we  find  that  the  semi -invariants  of  order  I,  +  !-»  +  .  .  . +1  =L 

1  2  n 

are 


(IB) 

The  first-order  semi -invariant  (mean  value)  of  the  process  is 


and  the  second-order  semi -invariants  are 

^j_tk^  =  J  u(t)u(t+t-tk)dt,  (20) 

-CD 

with  similar  expressions  for  the  higher -order  semi-invariants. 

The  limiting  case  as  n  -►oo  of  the  Poisson  process  is  the 
Gaussian  process.  All  semi -invariants  (18)  become  infinite  as 
n  -*co,  but  we  may  normalize  the  process  so  that  its  mean  is  zero 
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and  its  second-order  semi-invariants  are  independent  of  n  by  using 
the  normalized  variable  y  (t)  =  y(t)  -  X^/v^.  The  semi- invariants 
of  the  normalized  process  are 


*(L) 

Vz 


.1 


“TJ 

a 


+oo 


I  M  ‘-M  ” 


(2i) 

for  L  >  2,  with  X  '  9  *  0.  As  n  -►oo,  all  semi-invariants  of  order 
L  ^  3  vanish,  and  we  obtain  a  Gaussian  process  with  second-order 
semi -invariants 


x<*> 

Jk 


a 


,+oo 


-CD 


u(t)  u(t+tj-tk)  dt 


(22) 


The  Poisson  processes  can  be  used  to  construct  a  random 
process  having  given  higher -order  correlation  functions,  if  a 
deterministic  waveform  u(t)  can  be  found  with  the  required  higher - 
order  correlation  functions. 

The  Poisson  process  is  a  representation  of  the  output  of  a 
linear  device  which  is  driven  by  a  series  of  impulses  with  random 
amplitude  and  time  of  arrival,  since  the  waveform  u(t)  may  be 
taken  to  be  the  impulse  response  of  the  linear  device.  It  may  be 
used  to  represent  shot  noise  in  receivers,  atmospheric  static  in 
VLF  reception,  or  swept-frequency  jamming  in  a  narrow-band 
receiver. 


dt 
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IV.  DETECTOR  STRUCTURE  WITH  INDEPENDENT  SAMPLES 

The  likelihood  ratio  for  a  known  signal  S  in  noise  whose 
distribution  is  F(V)  is 

A  (V  ;S)  =  (23) 


is  we  assume  that  the  noise  is  additive.  If  a  class  of  possible  signals 
with  prior  distribution  cr(S)  is  to  be  detected,  we  use  the  averaged 
likelihood  ratio 


A(V)  =  f  cr(S)  A(V;S)  dS  = 


Jn<r(S)F(V-S)dS 

F(V) 


(24) 


where  U  is  the  class  of  possible  signals.  We  wish  to  examine  the 

characteristics  of  this  likelihood  ratio  for  arbitrary  signal  statistics 

cr(S)  and  noise  statistics  F(V).  The  optimum  detector  is  a  threshold 

on  the  likelihood  ratio.  Our  purpose  is  to  determine  its  structure 

and  then  to  find  error  probabilities. 

In  order  to  reduce  the  distributions  tr(S)  and  F(V)  to  finite-order 

distributions,  we  consider  only  sample  values  of  the  time -functions 

S  and  V  at  times  t  =  t^,  t^,  .  .  .  ,  tR  and  call  these  sample  values 

S  ,  S  .  ..,  S  and  V.,  V,,.#I,  V  ,  The  distributions  <r(S)  and  F(V) 

1  l  n  lb  n 

are  then  n-th  order  distributions  of  the  kind  discussed  in  Section  II. 

We  now  further  assume  that  the  samples  taken  at  different  times 
are  independent  in  both  signal  and  noise.  This  assumption  will  be 
removed  in  Section  V.  With  independent  sampling,  the  likelihood 
ratio  is 


A(V1(>. 


V  )  = 
n' 


5  Mvi,= 


IT 

j=1 


f  <r(S  )F(V  -S  )dS 

J  -00  J  j  j  J 
- - 


(25) 

and  we  need  only  consider  one  factor  of  the  product.  The 
detector  structure  is  most  conveniently  obtained  in  terms  of  the 
logarithm 
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MVt . vn)  = 


I  MV.)  =  log  A  (V. , 
j=l  J  1 


V  ) 
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n  +oo 

I  {log 
j=l  J  -oo 


<r(Sj)F(Vj“Sj)dSj’1°gF(Vj>}  • 


(26) 


The  expression  (26)  may  be  transformed  by  introducing  the 
characteristic  functions  of  the  first-order  distributions  of  signal 
and  noise,  which  are 


+s. (u)  = 

J 

p+°° 

i 

-oo 

exp 

h! 

<r(sj)  dS. 

(27) 

and 

,  +00 
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V(u,a  J 

-oo 

exp  [ 

iuV. 

jJ 

F(V.)  dV. 

J  J 

• 

(28) 

It  is  easily  shown  that  the  characteristic  function  of  the  distribution 
F(V\-Sj)  is  exp  £iuSj J  ^  (u)  and  that  the  characteristic  function  of 
the  distribution  ^ 

<r(S.)  FtV.-S.)  dS.  ,  (29) 

which  has  the  form  of  a  convolution,  is  (u)  ^  (u).  Since  these 

quantities  are  characteristic  functions,  thit  is,  Courier  transforms 
of  the  distributions,  we  may  write  the  distributions  as  inverse 
Fourier  transforms  in  the  form 


p+OO  ,  +00 

J  tfS.jFOyS.)  dS.  =  -|^  J  exp  [-iuVj*s  (u)*y  (u)  du 


and 


(30) 
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F<V  *  b 

p+CD 

oo  eXP 
-00 

[-iuVj]  +v.(u)  du 

(31) 

Then  each  term 

in  the  summation  (26)  may  be  written 

MV.)  =  log 

.+00 

J  <r(S.)  F(V.-S.)  dS.  -  log  F(V.) 

r+oo 
=  log  J 

-oo 

exp  ^-iuV^ 

1  du 
j  j 

(32) 

p+OO 

-  log  J 

-oo 

*i,p[-iuvj] 

♦y  (u)  du 

j 

This  transformed  expression  for  the  likelihood  ratio  has  two 
advantages  over  the  form  (26).  It  is  easy  to  obtain  power  series 
expansions  in  the  observed  data  V.,  since  we  need  only  expand  the 
exponential  factor  in  a  power  series  and  integrate  term-by-term. 

The  observed  data  V,  here  appear  only  in  the  exponential  factor. 

The  second  advantage  is  the  possibility  of  expanding  the  characteristic 
functions  in  terms  of  moments  or  semi -invariants  of  the  signal 
and  noise  distributions  and  thus  obtaining  a  description  of  the 
detector  in  terms  of  these  moments  or  semi -invariants. 

Expanding  the  integrals  in  (32)  into  power  series  in  V,  we  have 

,+00  00 

(33) 


and 
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(34) 


where 
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,  ,.k  .+oo  , 
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*k  .  +oo  t 
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du 


The  coefficients  and  are  "moments”  of  the  characteristic 
functions.  It  is  easy  to  show  that  these  coefficients  may  be 
expressed  in  the  form 


b  =  dnF(0) 

Dk  2ttk!  dVn 


(36) 


with  a  similar  expression  for  a^  in  terms  of  the  distribution  (29). 
These  coefficients  could  have  been  obtained  by  expanding  (26) 
directly. 

The  logarithms  may  be  expanded  in  power  series  in  V.,  with 

J 

the  r  esult 


oo 


MV.)  =  z  d.v; 
j  k=0  J 


(37) 


The  first  few  coefficients  are 
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(38) 


d2  = 


2aoa2 


2a 


2bob2  -  bl 
2b  1 


If  the  random  processes  are  assumed  to  be  stationary!  then  the 
coefficients  and  b^  will  be  the  same  for  each  component  of  the 
sampled  signal,  and  the  detector  structure  is 
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\(V)  =  dQn  +  d1(V1+V2+. .  .+Vn)  +  d2(vJ+V2+. .  .+VZ) 


+  d3(V^+V2  +  .  .  .+V3)  +  . . . 


(39) 


We  must  now  evaluate  the  coefficients  d^  from  (35)  and  (38), 
which  does  not  seem  to  be  possible  in  closed  form  in  any  very  use 
ful  way.  We  may,  however,  obtain  series  expansions  in  terms  of 
the  semi-invariants  of  the  processes.  These  semi-invariants  are 
defined  by 


co  X  (iu)m 

log  (u)  =  r  - 

J  m=l 

oo  K  (iu)m 
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(40) 


The  semi-invariants  of  the  distribution  (29)  are  the  sums 
of  the  semi -invariants  for  signal  and  noise  whenever  the  noise  is 
additive.  For  a  Gaussian  distribution,  only  the  first  two  semi¬ 
invariants  are  non-zero. 

The  coefficients  are  then  found  to  be 
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But  we  may  write 
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and  then  (41)  becomes 
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Cn.Wm  »+0° 


du 


where  C  is  the  m-th  coefficient  in  the  series  (42).  The  integrals 
m 

in  (43)  can  be  readily  evaluated  in  terms  of  X^+K^  and  X^+K^  from 
the  known  moments  of  the  Gaussian  distribution.  The  coefficients 
b^  are  obtained  from  (43)  by  putting  =  0  for  all  m. 

Although  the  evaluation  can  easily  be  carried  out  generally, 
we  shall  be  interested  primarily  in  the  detection  of  processes  with 
zero  mean  in  noise  of  zero  mean.  If  we  set  X^  =  =  0,  a  considerable 

simplification  results  and  we  obtain: 
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Similar  expressions  for  b^  are  obtained  by  putting  \m  =  0.  From 
these,  by  (38),  the  leading  terms  of  dj  and  d^  are  found  to  be: 
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For  Gaussian  distributions  of  both  signal  and  noise  the  exact 
result  is  given  by  the  first  term  of  d^,  with  all  other  coefficients 
zero. 

The  detector  structure  may  now  be  found  in  a  threshold  form. 

If  V  is  small  enough,  only  the  first  few  terms  of  the  power  series 
(39)  need  be  considered.  Generally,  a  detector  which  is  optimized 
for  small  input  signals  will  be  useful  for  large  signals  as  well. 

We  may  therefore  consider  a  threshold  detector  of  the  form 

\T(V)  =  d1(V1  +  . .  .  +  Vn)  +  d2(vj  +  .  .  .  +  V*)  .  (44) 

It  is  difficult  to  determine  the  validity  of  this  approximation,  other 
than  to  state  that  it  is  certainly  valid  for  sufficiently  small  input 
signals.  It  is  also  difficult  to  determine  the  coefficients  d^  and  d^, 
since  the  series  for  them  do  not  seem  to  converge  very  rapidly. 

The  threshold  form  (44)  of  the  optimum  detector  indicates 
the  general  character  of  the  detector  structure.  It  is  found  that  the 
optimum  threshold  detector  is  of  approximately  the  same  form  as 
the  optimum  detector  for  a  Gaussian  process.  The  weighting  co¬ 
efficients  are  functions  of  all  the  moments  (or  semi -invariants)  of 
both  the  signal  process  and  the  noise  process.  The  first-order 
term  is  not  zero  unless  both  signal  and  noise  processes  are 
symmetric,  zero  means  not  being  sufficient.  The  exact  optimum 
detector  is  a  function  of  all  powers  of  the  input  data. 

The  principal  conclusion  of  this  section  is  that  the  energy 
detector,  which  is  optimum  for  Gaussian  processes  in  Gaussian 
noise,  is  an  optimum  threshold  detector  for  signal  and  noise 
processes  which  are  both  symmetric  with  zero  means.  In  this 
case  the  higher -order  statistics  of  the  processes  are  irrelevant 


-18- 


to  the  detector  structure,  if  one  is  satisfied  with  a  threshold 
detector,  although  the  higher-order  statistics  have  a  significant 
effect  on  the  error  probabilities.  If  the  processes  are  unsymmetric 
or  have  non-zero  means,  then  the  linear  term  may  not  be  neglected 
and  the  detector  structure  is  more  complicated.  The  general  thres¬ 
hold  detector  is  dependent  on  all  orders  of  signal  and  noise 
statistics,  since  d^  and  will  appear  implicitly  and  not  as  an 
inessential  factor. 
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V.  DETECTOR  STRUCTURE  WITH  DEPENDENT  SAMPLES 

Extension  of  the  results  of  Section  IV  to  dependent  samples  can 
be  carried  out  by  the  same  methods.  The  likelihood  ratio  (24)  may 
be  expressed  in  terms  of  the  n-th  order  characteristic  functions 
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The  characteristic  function  of  the  distribution 
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The  distributions  F(V^,  ...»  V  )  and  (47)  may  be  written  as 
inverse  Fourier  transforms,  in  the  forms 
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Series  expansions  are  obtained  as  before  by  expanding  the 
exponentials,  giving  for  (48)  the  series 
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where  J  =  j^4- •  •  .  +jn  is  the  degree  of  the  term  in  V^,  •  .  .  V  . 
The  coefficients  are 
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Similar  expressions  are  obtained  for  the  distribution  (4V). 

If  the  process  is  stationary,  then  all  coefficients  of  order  J  =  1 
are  equal,  and  all  coefficients  of  order  J  =  2  depend  only  on  the  time 
differences  of  the  times  of  measurement  of  the  corresponding 
samples  Vj  and  V^. 

The  series  (50)  must  now  be  transformed  into  a  series  for  the 
logarithm  of  the  distribution  F(V^,  V^#  . . .  »  V  ).  The  first  few 
terms  of  this  series  are  readily  obtained,  and  the  detector  is  found 
to  have  the  form 
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Explicit  expressions  for  the  coefficients  in  the  series  (52)  may  be 
obtained  in  terms  of  the  coefficients  of  the  series  (50)  and  the 
analogous  series  for  the  distribution  (47),  It  is  found  that 


(53) 


Expressions  for  these  quantities  may  be  found  as  before  in  terms 
of  the  semi-invariants  of  the  signal  and  noise  processes. 

The  detector  structure  for  dependent  samples  is  seen  to  be 
quite  analogous  to  that  for  independent  samples.  Threshold 
detectors  may  be  defined  in  the  same  manner. 
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VI.  ERROR  PROBABILITIES 

The  approximate  computation  of  error  probabilities  is  simple 
when  a  large  number  of  independent  samples  are  available  or  when 
the  observation  time  is  long  compared  to  the  reciprocal  band-width 
of  the  noise  and  the  signal  process.  In  this  case,  the  distribution 
of  the  detector  output  is  approximately  Gaussian,  and  we  need 
only  compute  its  first  and  second  order  moments. 

To  simplify  the  calculations,  we  shall  compute  error 
probabilities  only  for  independent  samples.  Extension  to  dependent 
samples  is  obvious,  and  the  results  should  be  similar  when  the 
observation  time  is  long.  We  shall  also  consider  only  the 
quadratic  threshold  detector  with  symmetrical  signal  and  noise 
distributions,  which  has  the  form 


kT(v)  =  v*  +  v*+...  +  V2 


(54) 


In  this  case,  the  mean  and  variance  of  the  detector  output  are 
easily  calculated  and  well-known.  The  mean  is 


n  ~I  — 7 

=  7  vf  =  n  V 

k=l  k 


(55) 


and  the  second  moment  is 
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where  V  represents  the  m-th  moment  of  any  one  sample  of  the 
waveform  V.  The  variance  is  then 

2  2  77  .ITI.  2 

<r  =  a^-a^  =  nV  -  n( V  ) 


(57) 
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These  quantities  may  be  conveniently  expressed  in  terms  of  the 
semi-invariants  of  the  signal  and  noise  processes.  When  both 
signal  and  noise  are  present,  we  have 


a  4  =  n(K2  +  X.2) 

«r2  =  n(K4  +  \4)  +  2n(K2  +  \2)2  .  (58) 


When  only  noise  is  present  the  mean  and  variance  are  given  by  the 

same  expressions  with  =  0. 

The  fourth-order  moments  (or  semi-invariants)  play  an  important 

role  in  the  error  probabilities.  If  two  processes  with  the  same 

power  (equal  \^)  are  to  be  detected,  the  probabilities  of  detection 

will  differ  significantly  when  the  fourth-order  statistics  are 
3 

different. 

probabilities  for  more  general  detector  structures  may 
be  treated  similarly.  If  a  polynomial  of  order  K  is  used  to  represent 
a  threshold  detector,  then  the  input  statistics  of  all  orders  up  to 
2K  will  be  needed  to  determine  the  error  probabilities.  If  the 
samples  are  dependent  the  cross-moments  will  appear,  again  up  to 
order  2K. 

Computations  of  error  probabilities  are  given  in  Figures  1,  2, 
and  3.  In  each  case,  n  =  100  independent  samples  have  been  used. 

The  effects  of  the  fourth-order  statistics  have  been  represented  by 
the  coefficient  of  skewness 


Y2 


K4 

3 


or 


3 


(59) 


of  the  noise  or  signal  distributions.  A  Gaussian  distribution  has 
^2  =  0.  Calculations  have  been  made  for  Y2  s  5, 10,  and  20.  If 
the  non-Gaussian  distributions  are  considered  to  be  Poisson 
processes  (Section  III),  then  increasing  coefficients  of  skewness 
represent  increasing  impulsive  character  of  the  noise. 
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Each  curve  represents  the  probability  of  detection  of  the 
signal  process  with  a  Neyman-Pear son  detector  whose  false  alarm 
probability  is  10  .  For  convenience,  the  noise  variance  is 

taken  to  be  unity*  The  probability  of  detection  is  plotted  against 
the  signal  variance  X^,  which  when  normalized  may  be  considered 
to  be  the  signal-to-noise  power  ratio. 

Figure  1  shows  the  effects  of  non-Gaussian  background  noise. 
The  signal  process  is  Gaussian  for  all  curves  shown.  The 
increasingly  impulsive  character  of  the  noise,  as  increases, 
degrades  the  probability  of  detection  of  the  signal  process.  With 
highly  impulsive  noise  a  substantial  increase  in  the  signal  power 
may  be  needed  to  obtain  the  same  probability  of  detection. 

Figure  2  shows  the  effects  of  non-Gaussian  signals  received 
in  Gaussian  background  noise.  Some  degradation  of  the  probability 
of  detection  occurs,  but  the  degradation  is  much  smaller  than  that 
observed  with  non-Gaussian  background  noise. 

Figure  3  shows  the  probability  of  detection  of  a  non-Gaussian 
process  in  non-Gaussian  nci  se  when  both  processes  have  the  same 
coefficient  of  skewness.  The  degradation  in  P^  is  only  slightly 
larger  than  that  observed  when  the  noise  alone  is  non-Gaussian. 
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VII.  CONCLUSIONS 

The  optimum  detector  for  a  non -Gaussian  stochastic  signal 
in  non-Gaussian  noise  can  be  obtained  as  a  power  series  in  the  observed 
data.  Explicit  formulas  for  the  coefficients  of  this  power  series 
in  terms  of  the  characteristic  functions  of  the  signal  and  noise 
distributions  have  been  calculated.  Series  expansions  may  be 
found  for  the  coefficients  in  terms  of  the  semi -invariants  of  the 
signal  and  noise  distributions,  but  the  convergence  of  these  formal 
expansions  is  questionable. 

For  weak  signals,  the  case  of  principal  interest,  threshold 
detectors,  which  are  optimum  for  sufficiently  small  input  signals, 
may  be  obtained  by  truncating  the  power  series  at  some  convenient 
number  of  terms.  If  the  power  series  is  truncated  after  quadratic 
terms,  a  detector  is  obtained  which  is  exactly  optimum  for  Gaussian 
signal  and  noise  distributions  and  which  is  optimum  as  a  threshold 
detector  for  non-Gaussian  signal  and  noise. 

If  the  signal  and  noise  distributions  are  both  symmetric  with 
zero  mean,  the  linear  terms  are  zero  and  the  quadratic  terms  alone 
appear.  If  the  distributions  are  not  symmetric,  the  threshold 
detector  is  a  combination  of  linear  and  quadratic  terms.  The 
coefficients  of  these  terms  usually  involve  all  moments  of  both 
signal  and  noise  distributions,  but  in  some  cases  the  coefficients 
may  be  removed  as  inessential  factors. 

The  error  probabilities  for  the  quadratic  detector  are  strongly 

influenced  by  the  fourth-order  statistics  of  the  signal  and  noise 

3  4 

processes,  as  is  well-known  9  .  Computations  of  sensitivity 

for  various  coefficients  of  skewness  of  the  signal  and  noise 
distributions  have  been  made  for  the  quadratic  detector  with 
independent  samples.  A  Neyman-Pearson  detector  with  a  false - 
alarm  probability  of  10“2  has  been  used.  A  considerable  loss  of 
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sensitivity  is  observed  with  non-Gaussian  background  noise.  With 
a  skewness  coefficient  of  20,  as  much  as  5  db  more  signal  power 
may  be  needed  to  obtain  the  probability  of  detection  found  with 
Gaussian  noise  background.  Arbitrarily  large  losses  of  sensitivity 
may  be  obtained  with  very  large  skewness  coefficients,  which 
correspond  to  highly  impulsive  noise. 

The  detection  of  a  non-Gaussian  process  on  the  same  basis 
shows  that  losses  of  sensitivity  are  relatively  small.  The 
probabilities  of  detection  are  only  slightly  less  than  those  obtained 
with  a  Gaussian  signal  of  the  same  power. 

When  a  non-Gaussian  signal  is  detected  in  non-Gaussian  noise, 
the  probability  of  detection  is  degraded  by  about  the  same  amount 
as  if  only  the  noise  were  non-Gaussian.  It  appears  that  the  highei  - 
order  statistics  of  the  signal  process  are  relatively  unimportant, 
while  those  of  the  noise  process  are  quite  significant. 
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FIGURE  1  PROBABILITY  OF  DETECTION:  GAUSSIAN  SIGNAL  IN  NON-GAUSSIAN  NOISE. 
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FIGURE  2  PROBABILITY  OF  DETECTION:  NON -GAUSSIAN  SIGNAL  IN  GAUSSIAN  NOISE. 
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-GAUSSIAN  SIGNAL  IN  NON -GAUSSIAN  NOISE. 
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